Turing Machines 
Part Three 


What problems can we solve with a computer? 
A 


What kind of 
computer? 


Very Important Terminology 


Let M be a Turing machine. 
M accepts a string w if it enters an accept state when run on w. 
M rejects a string w if it enters a reject state when run on w. 


M loops infinitely (or just loops) on a string w if when run on w 
it enters neither an accept nor a reject state. (such a w is not in 
the language of this TM) 


does not reject : 
halts 


does not accept ` < 


Recognizable Languages (RE) 


e A language is called recognizable if it is the language 
of some TM. 


e For any w E€ 7(M), M accepts w. 
e For any w ¢ (M), M does not accept w. 


- M might reject, or it might loop forever. 


Decidable Languages (R) 
e A language L is called decidable if there exists a 


decider M such that (M) = L. 


- Decider machines are implemented in a way that 
they have no danger/possibility of looping forever. 


R and RE Languages 


Every decider is a Turing machine, but not 
every Turing machine is a decider. 


This means that RCRE. 
But is it a strict subset? 


That is, if you can just confirm “yes” answers to 
a problem, can you necessarily solve that 
problem? 


Which Picture is Correct? 
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All Languages 


Which Picture is Correct? 


All Languages 


To answer the question is Ra strict subset 
of RE, I need to quickly convince you of 
three little things. 


1. We can give a machine all kinds of inputs 
as a string, including groups of inputs and 
machines themselves! 


2. There is a TM that can take TMs as input 
and run them to see what they do. 
(“Universality” property) 


3. That TM, or any IM that takes other 
TMs as input, could take itself as input. 
(“Self-Reference” property) 


1. We can give a machine all kinds of inputs 
as a string, including groups of inputs and 
machines themselves! 


A Model for Solving Problems 


(accept) 


input 


How do we 
represent our 
inputs? 


(reject) 


On your computer, everything 


is numbers! 


Images (gif, jpg, png): 

Integers (int): 

Non-integer real numbers (double): 
Letters and words (ASCII, Unicode): 
Music (mp3): 

Movies (streaming) SIRANGER . 

Doge pictures | 


Email messages: 


binary numbers 
binary numbers 
binary numbers 
binary numbers 
binary numbers 
binary numbers 
binary numbers 
binary numbers 


Object Encodings 


e If Obj is some mathematical object that is discrete and 
finite, then we'll use the notation (Obj) to refer to some 
way of encoding that object as a string. 


e Think of (Obj) like a file on disk - it encodes some high- 
level object as a series of characters. 


= 11011100101110111100010011...110 


Object Encodings 


e For the purposes of what we're going to be doing, we aren't 
going to worry about exactly how objects are encoded. 


e For example, we could say (Gonin) to mean "some encoding of a 
Context-Free Grammar for the language 0=1»” without 
worrying about exactly how a grammar is encoded. 

e Intuition check: could I type up any grammar and save it as a file on 
my computer? Yes? Ok then, we know we can put a grammar into a 
string. 

e As long as we're convinced a thing could be saved in a 
file, we don’t spend time specifying the exact file format in our 
proof (some proofs do in certain circumstances where it might 
be questioned where it’s possible, but in this class we won’t). 


Encoding Groups of Objects 


e Given a group of objects Obj:, Obj2, ..., Objn, 
we can create a single string encoding all 
these objects. 

e Think of it like a .zip file! 

e We'll denote the encoding of all of these 

objects as a single string by (Obji, ..., Objn). 


e This lets us feed a group of inputs into our 
computational device as a single input. 


2. There is a TM that can take IMs as input 
and run them to see what they do. 


An Observation 


e When we've been discussing Turing 
machines, we've talked about designing 
specific TMs to solve specific problems. 


e Does this match your real-world 
experiences? Do you have one computing 
device for each task you need to 
perform? 


Can there be a program that simulates 
what another program does? 


e Sure. 


e These programs go by many names: 


- An interpreter, like the Java Virtual Machine or 
most implementations of Python. 


- A virtual machine, like VMWare or VirtualBox, 
that simulates an entire computer. 


Can there be a TM that simulates 
what another TM does? 


e Sure. 


e You could imagine a TM taking a TM table like 
this as input, and then seeing how it would 
perform on various sample inputs by 
Simulating its behavior by referring to the 
table at each step. 


The Universal Turing Machine 


e Theorem (Turing, 1936): There is a Turing machine U;,called the 
universal Turing machine that, when run on an input of the form 
(M, w), where M is a Turing machine and w is a string, simulates M 
running on w and does whatever M does on w (accepts, rejects, or loops). 


e The observable behavior of Us, is the following: 
e If M accepts w, then Um accepts (M, w). 
e IfM rejects w, then Um rejects (M, w). 
e IfM loops on w, then Um loops on (M, w). 
e Uim accepts (M, w) if and only if M accepts w. 
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Universal TM 


w | ...lnput.., C 


A Universal Machine 


A Universal Machine 


z  |r|oja|r|a|m z 


A Universal Machine 


z  |r|oja|r|a |m M z 


A Universal Machine 


The “program” is an encoding 
of some Turing machine M 
that we want to run. 


A Universal Machine 


The input to that program is 
some string 


A Universal Machine 


: p |r|oja|r| a | m Sinaia ae z 


The input has the form (M, w), where M is 
some TM and w is some string. 


A Universal Machine 


z  |r|oja|r|a |m M z 


ań 


(M, w) 


Since Urm is a IM, it has a language. 


What is the language of the universal 
Turing machine? 


The Language of U. 


Uru accepts (M, w) iff M is a TM that accepts w. 


Therefore: 
£(Uru) = { (M, w) | Mis a TM and M accepts w } 


For simplicity, define A, = £(Urw). This is an 
important language and we'll see it many times. 


Let M be the TM shown here. a-O.R H_gR 
How many of the following statements 


are true? 


M accepts aa 

U.,, accepts (M, aa) 
U.,, accepts (M, €) 
U.,, accepts (M, a) 


Answer at PollEv.com/cs103 or 
text CS103 to 22333 once to join, then a number. 


Let M be the TM shown here. a-O.R H_gR 
How many of the following statements 


are true? 


M accepts aa 

U.,, accepts (M, aa) 

U.,, accepts (M, e) is equivalent to (M, €) E€ Am 
U.,, accepts (M, a) 


Answer at PollEv.com/cs103 or 
text CS103 to 22333 once to join, then a number. 


CFLs RE 


All Languages 


3. That TM, or any IM that takes other 
TMs as input, could take itself as input. 
(“Self-Reference” property) 


Equivalence of TMs and Programs 


e Here's a sample program we might use to model a Turing 
machine for { w E {a, b}* | w has the same number of a's 
and b's }: 


int main() { 
string input = getInput(); 
int difference = 0; 


for (char ch: input) { 
if (ch == 'a') difference++; 
else if (ch == 'b') difference--; 
else reject(); 


} 


if (difference == 0) accept(); 
else reject(); 


Equivalence of TMs and Programs 


e Now, a new fact: it’s possible to build a method 
mySource() into a program, which returns the 
source code of the program. 


e For example, here's a narcissistic program: 


int main() { 
string me = mySource(); 
string input = getInput(); 


if (input == me) accept(); 
else reject(); 


Equivalence of TMs and Programs 


e Sometimes, TMs use other TMs as subroutines. 


e We can think of a decider for a language as a method that 
takes in some number of arguments and returns a boolean. 


e For example, a decider for { arbr | n € N } might be 
represented in software as a method with this signature: 


bool isAnBn(string w); 


e Similarly, a decider for + (m, n) |m, n € N and misa 
multiple of n } might be represented in software as a 
method with this signature: 


bool isMultipleOf(int m, int n); 


Side note: what does equivalence of 
TMs and programs mean for YOU? 


e In this class (starting Problem Set Nine, 
and unless directed otherwise) you can 
write proofs about TMs by just writing 
normal code (e.g., Java or C++), and 
never have to painstakingly draw an 
actual TM ever again! 


:: rejoicing :: 


Self-Referential : Danger: 


° So, I hope we've convinced you that 
there's nothing magic, impossible, or 
scary about a program getting a string 
version of its own code. 


e But, there are some dragons in the land 
of self-referential things.... 


True or false: 


"This string is 34 characters 
Long." 


True or false: 


"This string is 34 characters long." 
1234567890123456789012345678901234 


True or false: 


"This sentence is written in blue." 


Happy Story Time 


In a certain isolated town, every house has a 
lawn and the city requires them all to be 
mowed. The town has only one gardener, 

who is also a resident of the town, 
and this gardener mows the lawns of residents 
iff they do not mow their own lawn. 


Happy Story lime 


In a certain isolated town, every house has a 
lawn and the city requires them all to be 
mowed. The town has only one gardener, 

who is also a resident of the town, 
and this gardener mows the lawns of residents 
iff they do not mow their own lawn. 


True or false: The gardener mows their own lawn. 


Answer at PollEv.com/cs103 or 
text CS103 to 22333 once to join, then your response. 


MY NOSE WILL 


GROW NOW 


True or false: 


"This sentence is false." 


Seli-Reference in Set Theory 


e Now that we know that self-reference is dangerous 
(i.e., can lead to paradoxes) in propositions (e.g.,“This 
sentence is false”), we can look at it in other domains 
we ve studied, like Set Theory. 


e We know that sets can contain other sets. 


e They can even contain themselves (“The set of all sets” and 
"The set of all sets with infinite cardinality” both contain 
themselves). 


e Since we know that self-reference is dangerous, we might 
want to make a set called SAFE LIST that is the set of all 
sets that do not contain themselves, since any set on that 
list is safe from paradoxes. 


True or False? 


"The set of all sets that do not 
contain themselves contains itself." 


Answer at PollEv.com/cs103 or 
text CS103 to 22333 once to join, then your answer. 


Proofs by Contradiction in 
Number Theory 


e One way to think about proofs by contradiction is that 
they lead to a kind of “impossible” situation that is 
Similar to the paradoxes. Here is a simple example: 


e Thm. There is no greatest integer. 


Proof, by contradiction. Assume for the sake of 
contradiction that there is a greatest integer, call it g. 


[Now we will use g to write a mathematical expression that 
is a syntactically valid mathematical expression that should 
be fine to write, if g were real./ 


Letx=g+ 1. 
We see that x > g. 


But this is a contradiction, because g is the greatest integer. 
So the assumption is false and the theorem is true. m 


Proofs by Contradiction in 
Number Theory 


Observation: there is other math we 
* One way to think abc could have done on g that would not have 
they lead to a kind Ofjeg to an impossible situation. (For 
similar to the parado example, "Let x = g - 1.”) “Fixing the 
bug” in the math doesn’t actually fix 
anything, because it wasn’t the math that 
Proof, by contradict was buggy. It was g itself. The math did 
contradiction that thd what it needed to do to expose the 
problem with g. 


e Thm. There is no gre 


[Now we will use g to 
is a syntactically valid mathematical expression that shoula 
be fine to write, if g were real./ 


Letx=g+ 1. 
We see that x > g. 


But this is a contradiction, because g is the greatest integer. 


So the assumption is false and the theorem is true. m 


More Self-Reference! 


(this time with Turing Machines) 


The Problem of Looping TMs 


e Suppose we have a IM M and a String w. 


° If we run M on w, we may never find out 


whether w E€ AM) because M might loop 
on w. 


e Is there some algorithm we can use to 


determine whether M is eventually going 
to accept w? 


A Decider for Ay? 


e Recall: A, is the language of the 
universal Turing machine. 


e We know that (M, w) E€ A, if and only if 
M accepts w. 


. The universal Turing machine U,,,1s a 
recognizer for Am. Could we build a 
decider for Aru? 


A Decider for Ay? 


e Suppose that Am E R. 


e Formally, this means that there is a TM 
that decides Ary. 


e Intuitively, this means that there is a TM 
that takes as input a TM M and string w, 
then 
e accepts if M accepts w, and 
e rejects if M does not accept w. 


A Decider for willAccept? 


e To make the previous discussion more concrete, 
let's explore the analog for computer programs. 


e If Ay is decidable, we could construct a function 


bool willAccept(string program, 
String input) 
that takes in as input a program and a string, 
then returns true if the program will accept the 
input and false otherwise. 


e What could we do with this? 


e If Ay is decidable, we could construct a function 


bool willAccept(string program, 
string input) 


that takes in as input a program and a string, then 
returns true if the program will accept the input and 
false otherwise. 


How many of the following statements are true? 
willAccept("int main() £ accept(); 152, "Emu" ) returns true. 


willAccept("int main() £ reject(); Le: "Yak") returns false. 
willAccept("int main() { while (true) 4) }", "Cow") loops forever. 


Answer at PollEv.com/cs103 or 
text CS103 to 22333 once to join, then a number. 


What does this program do? 


bool willAccept(string program, string input) 


t 
} 


/* .. some implementation .. */ 


int main() { 
string me = mySource(); 
string input = getInput(); 


if (willAccept(me, input)) £ 
reject(); 

} else { 
accept(); 


What does this program do? 


boot willAccept(string program, 


t 
} 


string input) 


/* .. some implementation .. */ 


int main() { 
string me = mySource(); 
string input = getInput(); 


if (willAccę How many of the following statements are true? 


This program accepts at least one input. 
This program rejects at least one input. 
This program loops on at least one input. 


Answer at PollEv.com/cs103 or 
text CS103 to 22333 once to join, then a number. 


What does this program do? 


boot willAccept(string program, 


t 
} 


string input) 


/* .. some implementation .. */ 


int main() { 
string me = mySource(); 
string input = getInput(); 


Try running this program on any input. 
What happens if 


if (willAccept(me, in 
reject(); 

} else | 

accept( ); 


... this program accepts its input? 


What does this program do? 


boot willAccept(string program, 


t 
} 


string input) 


/* .. some implementation .. */ 


int main() { 
string me = mySource(); 
string input = getInput(); 


Try running this program on any input. 
What happens if 


if (willAccept(me, in 
reject(); 

} else | 
accept( ); 


... this program accepts its input? 
It rejects the input! 


... this program doesn't accept its input? 


What does this program do? 


boot willAccept(string program, 


t 
} 


string input) 


/* .. some implementation .. */ 


int main() { 
string me = mySource(); 
string input = getInput(); 


Try running this program on any input. 
What happens if 


if (willAccept(me, in 
reject(); 

} else | 
accept( ); 


... this program accepts its input? 
It rejects the input! 


... this program doesn't accept its input? 
It accepts the input! 


Knowing the Future 


e This TM is analogous to a classical 
philosophical/logical paradox: 


If you know what you are fated 
to do, can you avoid your fate? 


e If Ay is decidable, we can construct a TM that 
determines what it's going to do in the future 
(whether it will accept its input), then actively 
chooses to do the opposite. 


e This leads to an impossible situation with only one 
resolution: Arm must not be decidable! 


Next Time 


e Today we explored in code how assuming 
Ary 1S decidable leads to an impossible 
situation with only one resolution: Arm 
must not be decidable! 


e Next time we will write this up as an 
actual proof by contradiction. 


